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In "The Politics of Education" Paulo Freire considers 
writing evaluation to be the expression of educational ideologies. An 
examination of the scholarly writing in composition and rhetoric 
research shows a division between formative or process evaluation and 
summative or product evaluation, with advocates for each side. As 
readers, composition instructors attempt to construct students' 
texts — projecting on to those texts expectations, knowledge of codes, 
and normative beliefs regarding texts. Freire advocates that the 
eyaluator and the learner join in evaluation, thus establishing 
distance from the work under consideration and achieving one of the 
central goals of education--demystif ication of inherently ideological 
codes. Freire ideas were tested in writing workshops, with several 
important benefits: (1) evaluation became a dialogue between writers 
and readers, wherein reading and writing were viewed as cogenerative 
activities; (2) commentators never wrote directly on the students' 
papers, leaving the writers with authority over their texts — a 
dialogical model; (3) after each reader protocol session, reader 
expectations became clearer; and (4) reader protocols allowed the 
evaluator to render some particular biases less opaque and more o', »n 
to question by the students. Studies show that such evaluation ^ ould 
eventually be viewed as a dialectical process, a transactional .vent 
between students and teachers (readers and writers), and an 
exploration of summative criteria as a formative process. (NKA) 
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tvaiuation as Dialooical Praxis 
rts Paolo Freire notes in The Politics of tducation (1986). 
education is never neutral (p.lU;, never apolitical. Education 
always espouses an ideology whether that ideology be conscious or 
unconscious, humanizing or dehumanizing. Further, as Freire and 
other commentators such as Richard Uhmann tl976;) suggest, 
evaluation is deeply implicated in the political nature of 
education. For, evaluation is the expression of educational ideo- 
logies - normative systems which often express unconscious 
assumptions and consequently, perhaps, often produce dehumanizing 
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This paper, through an analysis of Paolo Preire's notion of 
evaluation, will suggest that sever? < hidden assumptions are also at 
work within Composition and Khetoric research into evaluation, 
specifically, this research is based upon a series of binary 
oppositions - between process and product, between subject and 
object, between formative tin process) and summative (product) 
evaluation. Unce this dichotomy is deconstructed, as it is in 
Freire' s model of evaluation, a far more powerful model of eva- 
luation becomes possible. In this model , instructors and their 
students can begin to view formative evaluation as the process 
Wherein summative concerns (conventions, criteria, norms) are 
Shared and critiqued as socially constructed belief systems, as 
ideologi es . 

Brooke Horvath's (OS4) distinction between formative or in 
process and summative or product evaluation reflects the divi- 
sion that has occurred in Composition and Khetoric research 
regarding evaluation. Virtually every rec^earcher into evaluation 
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can be aligned on either side of this great divide between pro- 
cess Cforrnative) or product tsununative) concerns. Advocates of 
formative evaluation such as Nancy Sommers (;iS82), C.W. Griffin 
C1982), Barry Kroll U3S0), and rtlan Purves ( 1 Sfc-4 ) have developed 
student-centered, supportive evaluation techniques while re- 
searchers such as Charles Cooper and Lee Udell (. |y77; have developed 
rationales and procedures for large-scale surnrnative testing. 

Both sides oT this great divide are already experiencing 
difficulty with this research paradigm. Assessment researchers 
such as Loren Barritt USbb) note that so-called consistent and 
objective grading systems are not nearly as objective or consis- 
tent as their designers belxeve. Barritt in his two year ethno- 
graphic study of large scale testing suggests, in fact, that 
formative concerns. that is, concerns for the student as an 
individual writer, preoccupy assessors far more than barritt and 
his researchers had originally believed. The problems of 
separating process from product are also noted by Wila Wolcott 

when she suggests that we are presently teaching students 
to write through process oriented methodologies, including 
formative evaluation, when, in tact, these students need to be 
able to write in surnrnative writing situations. 

As noted by Joe Belanger CISB-S), Margaret Mier UShb), and 
Edmund Miller (. many convinced formative instructors feel 

uneasy about responding in a supportive fashion to a paper in its 
draft stages and then later measuring that same paper against a 
strict set of standards. They point out that students can some- 
times misinterpret supportive commentary on drafts as evidence 
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that they will receive high grades or riiay view tentative grades 
on drafts as either discouraging or too encouraging. i he result 
at any rate is either a disgruntled student or an inadequate 
revision. 

Further, as Nancy .Somrners tlSyi.') notes, many writing teachers 
find It difficult to evaluate according to formative principles. 
They tend, her research suggests, to appropriate student texts by 
overrnarking them with vague; and confusing commentary regarding 
usage and form while ignoring content. Sommers puts her finger on 
ttic heart of the problem when she writes; 

Thus, we read student texts with biases about what the 
writer should have ...written, and our biases determine how 
we will comprehend the text. Vie read with our 
preconceptions and preoccupations, expecting to find 
errors, and the result is that we find errors and misread 
our students' texts, (p. |.^aj 

ttommers' response to thjs problem is interest inq. She suggests 
that we need to reverse this approach. "Uur comments," she says, 
"need to offer stu-lents revision tasks of a different order of 
complexity and sophistication from the ones that they themselves 
Identify, py forcing students back into the chaos, back to the 
point Where they are shaping ... their meaning" tp 1 .54 ) . in fact, 
Sommers is advocating e different set of biases, a different but 
still unacknowledged ideology And, in fact, .Sommers' bias is 
inevitable. As readers we attempt to construct our students' 
texts. To do so we cannot avoid projecting on to those texts our 
reader expectations, our knowledge of codes, our normative 
beliefs regarding texts, in other words the product concerns that 
we apply to texts. To iivoid doing so would be to cease to read, 
eut what we can do is be more aware of our criteria and its 
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suitability. to the text we a.^e i^eading. It is at this point that 
Freire offers a more compelling model of evaluation. 

in the Chapter "Peasants and Their Reading texts" Freire 
specifically addresses evaluation m terms of teacher education 
and draws an important distinction between what he calls 
inspection and evaluation. h re ire notes : 

through inspection educators just become objects of 
vigilance by a central organization. Through evaluation 
everyone is a subject along with the central organization in 
the act of criticism and establishing distance from thp work 

... tvaluation is not an act by which educator tt evalUc ^es 
educator til it's an act by which educato-s A and B together 
evaluate an experience, its development, and the obstacles 
one confronts along with any mistakes or errors Thus 
evaluation has a dialectical character. Cp.23) 

At first It might appear as if Freire is distinguishing 
summative evaluation from formative evaluation or, in his terms, 
separating inspection from evaluation. However, on closer 
analysis it becomes clear that although Freire rejects the false 
Objectivity of inspection or summative evaluation, his validation 
of What he calls "evaluation" cannot be interpreted as support 
for formative evaluation as defined by Horvath. in Freire's 
terms, the evaluator cannot simply participate in the process 
wxth the student. This, according to Freire, would constitute 
passive acquiesence to a normative system of beliefs. Kather, the 
evciluator together with the learner must actively join in 
evaluation as a "critical act" and thus establish distance from 
the .^■ork or project under consideration. As Freire makes clear in 
other contexts, this act or praxis constitutes one of the central 
activities of education - the demysti f i cat ion of codes, codes 
which are inherently ideological. 

Freire's view of evaluation can lead to practical 
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applications for writing instructors. i he following describes 
two writing projects designed to explore the notion that forma- 
tive evaluation treatec* as the act of disclosing and critiquing 
normative systems of criteria can p,? valuable as both a heuristic 
for teaching writing and as an evaluation procedure. 

As part of an effort to encourage a formative approach to 
evaluation and to promote Writing Pcross the Curriculum, the 
following program was offered to the faculty of the University of 
buelph. Faculty were informed that at their request a Writing 
Workshop would be conducted in their classroom. Ihe workshop 
would be jointly designed by the workshop co-ordinator and the 
instructor and would derive its material from papers that had 
already been graded or annotated. Instructors and their leaching 
Assistants were asked to actively participate in the worksho- 
with their students. 

Uunng the Academic Year 1 9a.b-afa about 2b workshops were 
conducted in disciplines ranging from History to Wildlife Biology 
and were well received by both faculty and students. 1 he model 
that guided the workshop designs i3flected Freire's notion of 
evaluation. Working from already graded drafts or papers, the co- 
ordinator Identified the areas where students obviously did 
not understand either formal conventions or discipline specific 
ways of thinking. ihe co-ord i nator , through contrastive analysis 
using the student's own work on dittos or overheads, discussed in 
an open way with students, in the presence of thexr instructor, the 
strategies which either did or did not work in a specific assign- 
ment. The co-ordinator 's role was to objectify, in Freire's 
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terms, the work i.e., disclose its socially com-.tructed nature, 
but at the same time to subjectivize or validate the real ppotj- 
leMs that students were experiencing in their attempts to master 
the ways ot knowing of different disciplines. 

In order to fully explore the value of using Freire's model, 
1 will describe, in case study fashion, one of these sessions 
conducted with Dr. Brown's fifth semester Wild Life Biology 
class. Ur. Brown believed in formative evaluation - so much so 
tnat he had divided the grade for the semester's research project 
into two grades - 30'^ for the draft and 70% for the final paper. 
Unfortunately, however, as was tne custom in this course, 
virtually all of the students had failed the draft portion ot the 
assignment. nost were either infuriated or discouraged by this 
exper lence . 

On reading over the heavily annotated drafts, it became 
clear that many of these students knew the surface features of 
report writing but were truly bewildered by the deep structure 
ways of thinking embodied in this genre. For example, during a 
contrast ive comparison of several Kesultn and Discussion sections 
It became clear that many did not underst^snd the logical 
distinction between the two sections. After all, several students 
argued since the results, for the purpose of this assignment, had 
been statistically analysed. were they not alr-aay interpretedY 
Why was a Discussion section even necessary? Ht this point the 
instructor and his Teaching Assistants joined m the debate and 
presented a clear rationale for the Discussion section. I hey were 
not interested in the computer results per se but in how those 
results related to or affected the problem at hand. 
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In the pro-ess ot the discussion it also became evident that 
students were struggling with the stylistic demands of the 
assignment. A comparison of two passages revealed, however, that 
writers were being rewarded for avoiding passive con?,truc t ions 
and yet remaining objective. This led to a spirited discussion in 
which the Whole problem of objectivity and subjectivity and their 
competing ideolog.es were discussed. The instructor admitted 
that he rould accept tr_- subjective voice m sc^.entific 
discourse, but that many of his colleagues could not. 
Accordingly, he urged students to master the objective voice only 
as conventional usage. This section of the workshop ended with a 
discussion of techniques involved in writing objectively while 
avoiding the passive construction. 

«5 an outsider playing a facilitator role together with the 
active participation of both instructors and students tand a good 
deal of tact and humour.) its was fairly easy to deconstruct and 
open up to criticism ways of knowing and evaluating 
characteristic of different disciplines. it is much more 
difficult to turn this methodology towards one's own evalua- 
tion practices. It is however, possible, to at least attempt such 
an enterptr i se . 

The following dialogical model, built on the work ot bleich 
U37&), Fish U-=iSOK Flower <.\3/3>. U'Hare U^ySJ and other 
commentators (bazerman, 19yo; Carey. 1 9S.b ; Comprone, iaS3; tde , 
1984; (dere, 13S0; Kroll, Mier, lyb'S; r^iitchell and laylor, 

r979; and Petersen, 19S2> was applied to student drafts by both 
instructor and peer evaluators. A blank piece of paper with oniy 
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the writer's and ^valuator ' s <: i . e . reader's) namss on it war, 
attached to each draft. Tt:e evaluator then wrote on t.he paper 
commenting on the draft using a simple number system - i for the 
first comment, 2 for the second comment etc. these numbers were 
t-hen placed in the margin of the draft. Thus, evaluat.ors did not 
write on the draft itself. Instead they attempted to record what 
It was like to read the draft as honestly, specifically and 
helpfully as they could. Further it was agreed that all comments 
would be clearly written without any use of abbreviations and 
that readers Cwho were, of course, at this point writers) had to 
justify their comments. In othf.r words, evaluatcrs could not 
Simply write down /4wk or Hr o or Ked . They had to explain why or 
how the text affected them. Thus, this evaluation model, which 1 
call the Reader Protocol model (.see hlower, ISSJ, for Writer 
Protocols) asks evaluators to attempt to articulate and clarify 
the often unspoken and unacknowledged criteria that is beinq 
applied to the text. 

several important benefits emerged from this experiment. 

1. tvaiuation berame a dialogue between writers and readers, a 
process wherein reading and writing were viewed as co-generative 
ac ti VI t i'is . 

2. ihe fact that commentators never wrote directly on the 
student'- text became an expression of a central pedagogical 
position I.e., that the writer had authority over his or her 
text . 

3. After each Header Protocol session reader expectations became 
clearer. For example, during a persuasive writing assignment it 
became evident that 1, as a reader, wanted writers to discuss 
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alternatives to their own position. This, then became an issue 
J.n the class, an issue which L had to defend and rationalize by 
bringing in models of niy ov.n and others writing in order to prove 
that this was, in fact, an effective strategy. 

4. Finally, 1 became aware to a larger extent of n^y own 
preconceptions. X began to see how discipline affected msny of my 
biases are. Like many writing teachers 1 am a product of English 
Studies, English Studies which is nou, a battle ground of 
competing ideologies - New Unties versus Ueconstructionists, 
Current Traditional Paradigmers versus New Rhetoricians. My 
Reader Protocols at least allowed me to render some of these 
biases less opaque, more open to question and thus more shareable 
with my students. 

These case studies ilJ.ustrate the role that a formative 
evaiuator can play - the act or praxis of both dramatizing and 
critizing the ot ten unconscious criteria that we apply as readers 
to student texts. fciy doing this we can avoid, perhaps, tha .Je- 
humanizing education F-eire describes which produces students who 
might say: 

Today at the university we learned that objectivity m 
science requires neutrality on the part of the scientist; u,e 

learned todey that knowledge is pure ana that the 

university is the site of this knowledge... We learned t.-day 
that reality is a given, that .t is our scientific 
impartiality that allow us to describe it somewhat as it ^s 
•bince we have described it as it is, we don't have \o 
investigate the principal reasons that woulc explain as 

itlS.Cp.nt!) 

In fact, Freire's notion of evaluation opens up the possiblity 
that evaluation could be viewed as a dialectical process, a 
transactional event between students and teachers considered as 
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readers and writers, an exploration ot sunur.ative enteric, as 
formative process. 
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